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Abstract — Multiagent systems consist of agents that locally exchange information through 
a physical network subject to a graph topology. Current control methods for networked mul¬ 
tiagent systems assume the knowledge of graph topologies in order to design distributed con¬ 
trol laws for achieving desired global system behaviors. However, this assumption may not be 
valid for situations where graph topologies are subject to uncertainties either due to changes 
in the physical network or the presence of modeling errors especially for multiagent systems 
involving a large number of interacting agents. Motivating from this standpoint, this paper 
studies distributed control of networked multiagent systems with uncertain graph topologies. 
The proposed framework involves a controller architecture that has an ability to adapt its feed¬ 
back gains in response to system variations. Specifically, we analytically show that the proposed 
controller drives the trajectories of a networked multiagent system subject to a graph topology 
with time-varying uncertainties to a close neighborhood of the trajectories of a given reference 
model having a desired graph topology. As a special case, we also show that a networked multi¬ 
agent system subject to a graph topology with constant uncertainties asymptotically converges 
to the trajectories of a given reference model. Although the main result of this paper is presented 
in the context of average consensus problem, the proposed framework can be used for many 
other problems related to networked multiagent systems with uncertain graph topologies. 
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1. Introduction 


Multiagent systems consist of agents that locally exchange information through a physical 
network subject to a graph topology. Current control methods for networked multiagent sys¬ 
tems assume the knowledge of graph topologies in order to design distributed control laws for 
achieving desired global system behaviors (see, for example, U and references therein). How¬ 
ever, this assumption may not be valid for situations where graph topologies are subject to un¬ 
certainties either due to changes in the physical network or the presence of modeling errors 
especially for multiagent systems involving a large number of interacting agents. 

Uncertain nature of networked multiagent systems has received a considerable attention re¬ 
cently, including notable results I214T0I. For achieving desired multiagent system behavior, [HO 
make a specific assumption on the network connectivity other than the standard assumption 
on the connectedness of networked agents. The authors of GD excite the multiagent system in 
order to detect and isolate the uncertain agents from the network topology. Like (HO, a com¬ 
putationally expensive and not scalable algorithm is proposed in [5l|6| based on input observers 
technique, where the effect of uncertain agents on the overall multiagent system performance 
is quantified. An extension of this work is also given in Q that focuses on the detection and 
isolation of uncertain agents. The authors of [8j(9] use an adaptive control approach in order to 
suppress the effect of uncertain agents on the overall multiagent system performance without 
making specific assumptions on the fraction of misbehaving agents. A common similarity of 
the approaches documented in ES® is that they model uncertainties in the agent dynamics as 
additive perturbations that do not depend on the state of agents, where these results are not 
applicable to the networked multiagent systems with graph topology uncertainties since such 
uncertainties depend on the state of agents. 

One relevant work to the results of this paper is recently appeared in [10], where the authors 
utilize adaptive and sliding mode control methodologies in order to enforce a networked mul¬ 
tiagent system subject to an uncertain graph topology to follow a given reference model having 
a desired graph topology. However, the result in [10] may require a centralized information 
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exchange among networked agents in general due to the structure of the proposed control al¬ 
gorithm (see (8) or (18) of [10]). Other important results, which are related to this paper, are 
presented in fTTHTHl without requiring a centralized information exchange. However, these re¬ 
sults hold for graph topologies subject to constant uncertainties only. 

In this paper, we study distributed control of networked multiagent systems with uncertain 
graph topologies. The proposed framework involves a novel controller architecture that has 
an ability to adapt its feedback gains in response to system variations. Specifically, we analyti¬ 
cally show that the proposed controller drives the trajectories of a networked multiagent system 
subject to a graph topology with time-varying uncertainties to a close neighborhood of the tra¬ 
jectories of a given reference model having a desired graph topology. As a special case, we also 
show that a networked multiagent system subject to a graph topology with constant uncertain¬ 
ties asymptotically converges to the trajectories of a given reference model. Although the main 
result of this paper is presented in the context of average consensus problem, the proposed 
framework can be used for many other problems related to networked multiagent systems with 
uncertain graph topologies. 

2. Notation, Definitions, and Graph-Theoretic Notions 

The notation used in this paper is fairly standard. Specifically, IR denotes the set of real num¬ 
bers, K” denotes the set of n x 1 real column vectors, K nx m denotes the set of n x m real matrices, 
K+ denotes the set of positive real numbers, IR” X ” (resp., U." xn ) denotes the set ofnxn positive- 
definite (resp., nonnegative-definite) real matrices, §” x ” (resp., §”*”) denotes the set of n x n 
symmetric positive-definite (resp., symmetric nonnegative-definite) real matrices, 0 „ (resp., l n 
) denotes the nxl vector of all zeros (resp., ones), and \ n denotes the n* n identity matrix. Fur¬ 
thermore, we write (-) T for transpose, || • H 2 for the Euclidian norm, A m i n (A) (resp., A max (A)) for 
the minimum (resp., maximum) eigenvalue of the Hermitian matrix A, A/(A) for the z'-th eigen¬ 
value of A (A is symmetric and the eigenvalues are ordered from least to greatest value), diag(a) 
for the diagonal matrix with the vector a on its diagonal, and [A] ij for the entry of the matrix A 
on the z'-th row and j-th column. 
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Next, we recall some of the basic notions from graph theory, where we refer to (T) for fur¬ 
ther details. In the multiagent literature, graphs are broadly adopted to encode interactions in 
networked systems. An undirected graph Q is defined by a set Vg = {1,..., n} of nodes and a set 
Eg c Vg x Vg of edges. If [i, j) £ Eg, then the nodes i and j are neighbors and the neighboring 
relation is indicated with i ~ j. The degree of a node is given by the number of its neighbors. 
Letting di be the degree of node i, then the degree matrix of a graph Q, V{Q) e U nxn , is given 
by V[Q) = diag {d), d = [di,...,d n \ T . A path i 0 t'i... ii is a finite sequence of nodes such that 
4-i ~ 4, k= 1,..., L, and a graph Q is connected if there is a path between any pair of distinct 
nodes. The adjacency matrix of a graph Q, A{G) £ IR" xn , is given by 


[Am a = 


1, 

0, 


if H,j) t£g, 
otherwise. 


The Laplacian matrix of a graph, C(G) e S+*”, playing a central role in many graph theoretic 
treatments of multiagent systems, is given by C[Q) = V(Q) - A{G), where the spectrum of the 
Laplacian of a connected, undirected graph Q can be ordered as 


o = xvcm < x 2 {cm < • • • < 


in 


with 1„ as the eigenvector corresponding to the zero eigenvalue \\{C{Q)) and C(S)l n = 0„ and 

e £(P) i _ i 

c *-n ~ L n* 

3. Problem Formulation 


Consider a multiagent system consisting of n agents that locally exchange information ac¬ 
cording to a connected, undirected uncertain graph with nodes and edges representing 
agents and interagent information exchange links, respectively. We assume that the network 
is static, and hence, agent evolution will not cause edges to appear or disappear in the network. 
Specifically, let jq(D e IR denote the state of node i at time t e IR+, whose dynamics is described 

by 

Xi(t) = -ai{t)Xi{t) + J^J5ij[t)Xj{t) + Ui{t), X;(0) = Xio, (2) 

i~j 
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Figure 1: Trajectories of three agents on a line graph subject to initial conditions (x 10 , x 20 , *30 = 
(0.2,0.4,1.2) for (a) (ai,a 2 ,a 3 ) = (1,2,1) and C/3 i 2 ,/3 2 i,/ 3 23 ,yS 32 ) = d,l,U), (b) 
(ai,a 2 ,a 3 ) = (1,1.1,1) and (j6i 2 ,(6 2 i,(6 23 ,(6 32 ) = (1,0.1,1,1), (c) (ai,a 2 ,a 3 ) = 
(1,2,1) and ((812,(821,(823,(632) = (-1,-1,1,1), and (d) (ai,a 2 ,a 3 ) = (1,1.5,1) and 
((8i2,/)2i,(8 2 3,(8 32 ) = (1,1,1, !)• 

where a/(f) e U and /3 ; - /(t) e IR are unknown bounded coefficients of the graph Q u with bounded 
time derivatives, and u* (f) eR, t e IR+, is the control input of node z. In this paper, we are inter¬ 
ested to design a distributed control input w,-(f), f e IR+, such that (0 achieves average consen¬ 
sus approximately (or asymptotically, i.e., x(f) —> (l ; ,l^/n)x 0 as f— 00, x(f) = [xi(t),...,x„(f)] T e 
IR") in the presence of an uncertain graph topology. 

Remark 1. In the absence of proper control inputs i/j(t) e IR, t £ IR+, 0 cannot necessarily 
achieve average consensus. To elucidate this point, let unknown coefficients of the graph Q u be 
constant, i.e., (a 2 -(f), Pi jit)) = (a,,j6 !; -), and consider four cases given in FigureQ]that show tra¬ 
jectories of three agents on a line graph subject to initial conditions (xio, x 2 o, x 3 o) = (0.2,0.4,1.2). 
Since a t = Y.i~j Pij and (3 ; y = fiji in case (a), this case results in average consensus at point 
(l„l^/n)x 0 = 0.6. Since (Si 2 ^ (3 2 i in case (b), this case does not result in average consensus at 
point 0.6. Case (c) considers a multiagent system with antagonistic interactions [14|, and hence, 


4 










it does not result in average consensus due to the existence of multiple equilibrium points. Fi¬ 
nally, since a, ^ T.i~j Pij for i = 2 in case (d), this case does not result in average consensus 
as well. In summary, © results in average consensus if = 'Li-j Pij and = /3 ji £ R+ (I5l . 
However, this cannot be justified due to unknown coefficients of the graph Q u , and hence, one 
needs to design proper control inputs Ui(t) £ R, teU+. 

Next, we propose a control input iq(f) e IR, t £ R+, to drive the trajectories of © to a close 
neighborhood of a given reference model having a desired graph topology without requiring 
a centralized information exchange among networked agents. For this purpose, consider the 
reference model that locally exchange information according to a connected, undirected graph 
Q given by 

nit) = - ri(0) = x io , (3) 

i~j 

where r, ( t) £ IR, t £ R + , denotes the state of the reference model for node i. Note that 

lim r{t) = (l n l^/ n)xo, (4) 

t—+ OO 

where r{t) = [ri(f),..., r n (t)] T £ R". Throughout this paper we assume that the nodes and edges 
of graphs Q and Q u coincide, however the graph Q u is subject to unknown coefficients aqff) and 
Pij(t), as discussed earlier. 

Remark 2. The reference model given by © can be easily extended to 

rdt) = -J^ZijinW-rjit)), r/( 0) = x ;0 , (5) 

i~j 

without changing the following results of this paper, where = T.i~ j tij and = £ } j l £ R+. 

Remark 3. Note that © can be equivalently written as 

U ( t) = -dirt[t) + ^ rj ( t ), n (0) = Xio, (6) 

i~j 

where di is the degree of node i on graph Q. Therefore, if one knows the coefficients a, (f) and 
Pij(t) of© then the control input 

Uiit) = -{di-diityxiW + J^ll-Pij{t))xj{t), (7) 

i~j 
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results in average consensus at point [\ n \ T n l n)XQ. 

Since the control input 0 given in Remark 3 is not feasible due to unknown coefficients apt) 
and (3ij(t), we propose the adaptive control input given by 


Ui{t) = -ki{xi[t)-r i [t))-Wi{t)Xi{t)-Y J Wij[.t)Xj{t), 


( 8 ) 


where /q £ IR+ for at least one agent or a subset of agents (and /q = 0 for others), and the esti¬ 
mates Wilt) £ U and Wij{t ) £ U, t £ U+, satisfy the update laws 



(9) 



( 10 ) 


with y i £ U+ and jij £ IR+ being the corresponding learning rates. In the update laws given by © 
and dTOjl , Proj denotes the projection operator 1161171 . which is used to keep the estimates Wi ( t) 
and Wij{t) bounded for all t eU + . In the next section, we analytically show that the proposed 
adaptive control input given by © along with the update laws © and (ITOl drives the trajectories 
of © to a close neighborhood of the reference model trajectories given by ©. 

4. Stability Analysis 

In this section, we establish stability properties of the proposed adaptive control input given 
by © along with the update laws © and ([TOj. For this purpose, let 


ei(t) = Xi{t)-ri(t), teU+, 


( 11 ) 


denote the local error dynamics that satisfy 


ei{t) = -ai{t)Xi{t) + Y, Pij(t)Xjit) + Ui(t) + dintt) ~Y,rj(t) 


ai(t)Xi(t) + £ Pij(t)Xj{t) + Uiit ) + dtriit) - £ r ; (f) + d/x f (f) 


i~j 


-d i xdt) + Y J Xj{t)-Y,Xj{t) 


= -dielit) + Y, ej(t) + (dj - a;(f))x,-(f) + YiPijW - 1 )xj(t) + u t {t) 
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( 12 ) 


= - Y [ept) - ej{f)] + Wi{t)Xi{f) + Y w t j{t)Xj{t) + w f (f) 

*'~7 *'-/ 

= - - ey(f)) + o’ ! -(f)x/(f) + Y Wij{t)Xj{t ) - £,•<?,• (t) 

i~i i-j 

-Wi(t)Xi[t) - Y mj{t)Xj{t ) 
i-j 

= -kiei(t) - Y[ei{t) - ej[t))-Wiit)Xi(t) - YwijWxjd), e t (0) = 0, 

where 


Wpt) = Wpt)-Wpt), 

teU+, 

(13) 

Wijit) = Wijit) -Wijit), 

teU+, 

(14) 


Wi ( t) = di -apt), t € IR+, and Wijit) = Pi jit) - 1, t e IR+. In addition, it follows from ® and (fldt 
that 

= yiProjfu>iU). x;(f)(^(f) - r,-(f)))-wdf), m>,-(0) = m>; 0 » (15) 

ii>i;(f) = YijPro)[wijit), Xjit)[xiit) -n (f))j- Wijit), Wij{0) = Wijo, (16) 

where w i0 = u>i 0 - Wi and Wijo = Wij 0 - w t j. Note that wpt) and Wijit) are bounded since it 
is assumed that unknown bounded coefficients apt) and Pi jit) have bounded time derivates. 
We now state the following lemma necessary for the results of this section. 

Lemma 1. Let K = diag(k), k = [k\,k 2 ,..., k n ] T , ki £ IR+, i = 1,..., n, and assume that at least 
one element of k is nonzero. Then, for the Laplacian of a connected, undirected graph, 

Tig)=ag)+Ke§ n + xn , U7) 

and detQFiQ)) ^ 0. 

Proof. Consider the decomposition K = K\ + K 2 , where Ki = diag([O,...,O,0 i -,O,...,O] T ) and 
K 2 = K-Ki, where <pi denotes the smallest nonzero diagonal element of K appearing on its 
z-th diagonal, so that K 2 e §" ". From the Rayleigh’s Quotient (18), the minimum eigenvalue of 
CiQ) + K\ can be given by 

Amin iCiQ) + Ki) = rnin{x T {CiQ) + Kfjx | x T x = 1}, (18) 
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where x is the eigenvector corresponding to this minimum eigenvalue. Note that since C{Q) e 

j 2 x Yl ]1 X Yl 

§ + and K\ e § + , and hence, C(Q) + K\ is real and symmetric, x is a real eigenvector. Now, 

expanding HU as 


x t [C(G) + Ki)x = J^iXi-Xj) 2 + (piX 2 it (19) 

i~7 

and noting that the right hand side of C[9} is zero only if x = 0, it follows that A m i n (£ (£/) + Ki ) > 0, 
and hence, C(Q) + K\ e §” xn . Finally, let A be an eigenvalue of T{Q) - C[Q) + K\ + K 2 . Since 
Amin(£((?) + Ki) > 0 and A m i n (I 2 ) = 0, it follows from Fact 5.11.3 of jT9] that A m i n {C(Q) + K\) + 
^ A, and hence, A > 0, which implies that CEIJ holds and det {FiG)) fO. ■ 

The next theorem presents the first result of this section. 

Theorem 1. Consider the networked multiagent system given by © subject to an uncertain 
graph topology, the reference model given by ©, the adaptive control input given by ©, and 
the update laws given by © and QO). Then, the solution (e ; -(F)> wft), Wij(t )) of the closed-loop 
dynamical system given by JT2l . dTHl) . and HU) is bounded for all (0, w>; 0 , Wijo), t e IR+, and 
Proof. First consider the quadratic function given by 


Vi{ei, w i} wij ) 


^ i~j 


( 20 ) 


and note that V)(0,0,0) = 0 and Vj(e;, u> ; -, Wij) e IR+, (e/, Wf, Wij ) f (0,0,0). Furthermore, V/(e ; -, 
Wi, Wij ) is radially unbounded. Differentiating ©B along the closed-loop trajectories of JT2t . 
( fl5l l , and ©B yields 


Vi[ei(t),Wi(t),Wij(t)) < - e t ( t) Y^ieft)- ej {t))~ k t e 2 ( t) + w* , (21) 

i~j 

where w* is an upper bound satisfying ||77 1 (d>/(t) - Wi[t))wft ) + 'Li~j7jj[tiij{t) - Wij{t )) 
■iVij(t)\\ 2 < w*, t eU+. Note that w* exists since all the terms inside the norm operator are 
bounded and projection operator is used for the estimates wft) and Wij{t). Now, consider the 
Lyapunov function candidate given by 

n 

V(-) = Y. V i( e i> W i< W ij^‘ (22) 

i =1 
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The time derivative of ll22) is given using I2TT) as 


V(-) < -e T {t)[jC(G) + K)e(t) + w*, w* = Y, w h (23) 

! = 1 

where C(Q) denotes the Laplacian matrix of {3), K = diag(fc), k- [k\,k 2 ,..., k n ] T , ki e U+, and 
e{t) = [ei(t),...,e n {t)} [ . From the definition of the adaptive control input in ((8), notice that 
at least one element of k is nonzero. This implies from Lemma 1 that £{Q) + K e and 
det(£(t?) + K) f 0, andhence, A m i n {C(G) + K)\\e{t)\\ 2 < e T {t)[C{Q) + K)e{t). Now, since V"(-) < 0 
when || e[t) \\ 2 > w* I A m i n [£(Q) + K), it follows that the closed-loop dynamical system given by 
Q2), JT5ll . and {T6]l is bounded for all (0, u>/ 0 , Wijo), te IR+, and {i,j). ■ 

Remark 4. In order to drive the trajectories of © to a close neighborhood of the reference 
model trajectories given by ©, the perturbation term w* in {25]) needs to be small. This holds 
if the time derivative of unknown coefficients a/(f) and /3 ; / '(t) is small. If this is not true, then 
one can increase the learning rates y ; - and ji j to make w* small. 

As a special case when the unknown coefficients are constant, i.e., (cc z -(r), /8/y (t)) = (a/.jSiy), 
the next theorem shows that the proposed adaptive control input given by {8) along with the 
update laws {9j and {TO]) asymptotically drives the trajectories of {2] to the reference model tra¬ 
jectories given by {5). 

Theorem 2. Consider the networked multiagent system given by {2| subject to an uncertain 
graph topology, the reference model given by {3j, the adaptive control input given by {8), and 
the update laws given by {9) and {TO). Then, the solution zDj(f), Wij{t )) of the closed-loop 

dynamical system given by {TO), {TO), and {TO) is Lyapunov stable for all (0, M> i0 , Wijo]> t eU + , 
and andlimf^ooed?) = 0forall i. In addition, lim^ooXlt) = {\ n l T n l n)XQ. 

Proof. To show the Lyapunov stability of the closed-loop dynamical system given by {TO), 
{TO), and {TO), first consider the quadratic function given by {20). Differentiating {20) along the 
closed-loop trajectories of {TO), {TO), and {TO) yields 

Vi[ei{t),Wi(t),Wij(t)) < -e i {t)Y d {e i {t) - ejit^-kie]^). (24) 

i~j 

Now, consider the Lyapunov function candidate given by {22) , where the time derivative of {22) 
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VT) < -e T {t)[C{g) + K)e{t), 


(25) 


is given using (24) as 


where C{Q) denotes the Laplacian matrix of ©, K = diag(fc), k = [fci, k2,... , k n ] T , ki e IR+, and 
e{t) = [e\{t),...,e n {t)] T . From the definition of the adaptive control input in ©, notice that 
at least one element of k is nonzero. This implies from Lemma 1 that C{Q) + K e §” xn and 
det(£(£) + K) ^ 0. Hence, the closed-loop dynamical system given by Q2I, Q2]), and {EJ) is 
Lyapunov stable for all (0, wiq, Wijo), t e U+, and 

Next, it follows from |20) that lim f ^oo e T ( t) [C [Q )+ K) e ( t) = 0 holds, which implies that lim f ^oo 
e[t) = 0 as a consequence of det {C(Q) + K) ^ 0. The result lim f ^ooX(f) = (l„l^/n)x 0 is now 
immediate. ■ 

Remark 5. We now revisit the example in Remark 1 and use the adaptive control input given 
by © with the update laws given by @ and ([Toll. In particular, we set (/ci, k 2 , /c 3 ) = (5,5,0) and 
Ti = Jij = 5 for all (i,j), and use zero initial conditions for the update laws. Figure [ 2 ] shows that 
the proposed approach achieves average consensus for all cases, i.e., lim^oo Xi(t) = 0.6 for all 
i, as expected from Theorem 2. 

5. Conclusion 

In order to contribute to the previous studies in networked multiagent systems, we inves¬ 
tigated an adaptive control methodology that has an ability to drive the trajectories of an un¬ 
certain and time-varying multiagent system to a close neighborhood of the trajectories of a 
given reference model having a desired graph topology. In the context of average consensus 
problem, we rigorously analyzed stability properties of this methodology using results from 
nonlinear systems theory and matrix mathematics. In addition, as a special case when the un¬ 
known coefficients of the graph are constant, we showed that the uncertain multiagent system 
asymptotically converges to the given reference model with the proposed control methodology. 
Illustrative examples indicated that the presented theory and its numerical results are compat¬ 
ible. 
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(a) 


(b) 






Figure 2: Trajectories of three agents on a line graph subject to initial conditions 
(xio,x 2 o,X 3 o = (0.2,0.4,1.2) and the proposed approach for (a) (ai,a 2 ,« 3 ) = (1,2,1) 
and (/Ii 2 >/l 2 i>^ 23 > j^ 3 2 ) = ( 1 , 1 , 1 , 1 ), (b) (ai,a 2 ,a 3 ) = ( 1 , 1 . 1 , 1 ) and (^i 2 ,/l 2 i> ^ 23 ,^ 32 ) = 
( 1 , 0 . 1 , 1 , 1 ), (c) (ai,a 2 ,a 3 ) = ( 1 , 2 , 1 ) and (fiu,@ 21 ,@ 23 , 032 ) = (- 1 ,- 1 , 1 , 1 ), and (d) 
[a\, a 2 , CZ 3 ) = (1,1.5,1) and {@ 12 , /I 21 , /I 23 , @ 32 ) = (1,1,1, !)• 
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